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The MAILING DATE of this communication appears on the cover sheet with the correspondence address - 
Period for Reply 

A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) FROM 
THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1.136(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 
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- If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication. 
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Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent temri adjustment. See 37 CFR 1.704(b). 

Status 

i )□ Responsive to communication(s) filed on . 
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closed in accordance with the practice under Ex parte Quayle, 1935 CD. 1 1 , 453 O.G. 213. 
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4) ^ Claim(s) 1-14 is/are pending in the application. 
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6) ^ Claim (s) 1-14 is/are rejected. 
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Application Papers 
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Priority under 35 U.S.G. § 119 

12) S Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 1 19(a)-{d) or (f). 
a)IEI All b)n Some * c)^ None of: 
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Attachnient(s) 

1) S Notice of References Cited (PTO-892) 4) □ Interview Summary (PTO-413) 

2) Q Notice of Draftsperson's Patent Drawing Review (PTO-948) Paper No(s)/Mail Date. . 

3) ^ Infomnation Disclosure Statement(s) (PTO-1449 or PTO/SB/08) 5) □ Notice of Infomial Patent Application (PTO-152) 

Paper No(s)/Mail Date LS- 6) O Other: . 



U.S. Patent and Trademark Office 
PTOL-326 (Rev. 1-04) 



Office Action Summary 



Part of Paper No./Mail Date 9 





Application/Control Number: 09/884,079 
Art Unit: 2624 



Page 2 



Specification 



1. 



The incorporation of essential material in the specification by reference to a 



foreign application or patent, or to a publication is improper. Applicant is required to amend the 
disclosure to include the material incorporated by reference. The amendment must be 
accompanied by an affidavit or declaration executed by the applicant, or a practitioner 
representing the applicant, stating that the amendatory material consists of the same material 
incorporated by reference in the referencing apphcation. See In re Hawkins, 486 F.2d 569, 179 
USPQ 157 (CCPA 1973); In re Hawkins, 486 F.2d 579, 179 USPQ 163 (CCPA 1973); and/« re 
Hawkins, 486 F.2d 577, 179 USPQ 167 (CCPA 1973). 

The Applicants make incorporation of essential material in the specification by reference 
Korean Patent Application No. 00-62163 in page 7, lines 15-18. Korean Patent Apphcation No. 
00-62163 is not the priority foreign apphcation of the present application and thus cannot be 
incorporated. 



2. Claims 1-14 are rejected under 35 U.S.C. 112, first paragraph, as failing to 
comply with the enablement requirement. The claim(s) contains subject matter which was not 
described in the specification in such a way as to enable one skilled in the art to which it pertains, 
or with which it is most nearly connected, to make and/or use the invention. 

a. In page 10, lines 13-20, the specification states that: 



Claim Rejections - 35 USC § 112 
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"Next, the similarity is determined based on the continuous relaxation labeling with the compatibility 
coefficients (step 108). As previously described, in a continuous relaxation labeling process, the initial probability is 
updated on the basis of compatibility coefficients, and a more recent labeling status. Once the initial probability is 
assumed, the probability is updated depending on the compatibility coefficients. The compatibility coefficients are 
used in modeling possible matching conditions to reach a satisfactory labeling." 

(1) How the similarity is determined based on the continuous relaxation labeling with the 

compatibility coefficients is not taught in the specification. (2) How the compatibility 
coefficients are used in modeling possible matching conditions to reach a satisfactory labeling is 
neither disclosed in the specification. The Applicants are requested to point out explicitly where 
in the specification that can enable one skilled in the art to which it pertains, or with which it is 
most nearly connected, to implement the tasks recited in the above statements (1) and (2). More 
specifically, how a line j is finally labeled with a selected label is not clear. 

Because Claim 1 calls for the limitation of "measuring the similarity between the query 
and model images on the basis of continuous relaxation labeling using the compatibility 
coefficients." 

b. The meaning of the equation that defines p(i, j, K in page 10 is not clear. 

- How shall one calculate the following expression? Is it a multiplication operation? If 
yes, how can it be a measure of difference in compatibility between node-label pairs? What is a? 

c. The symbols aj and a shown in the equations in page 11 are not defined. Without 
clear definitions of these symbols, one carmot implement the claimed invention. 
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The following is a quotation of the second paragraph of 35 U.S.C. 1 12: 



The specification shall conclude with one or more claims particularly pointing out and distinctly claiming the 
subject matter which the applicant regards as his invention. 



1. Claims 9 and 1 1-12 are rejected xmder 35 U.S.C. 1 12, second paragraph, as being 
indefinite for the following reasons. 

- Claim 9 refers the symbol a that is not defined either in claims nor specification. 

— Claim 1 1 refers the symbol aj that is not defined either in claims nor specification. 



~ Claim 12 refers the symbol a that is not defined either in claims nor specification. 
~ Claim 9 recites an equation related to the following expression for which the operation 
is not clear: 



2. The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that 
form the basis for the rejections under this section made in this Office action: 
A person shall be entitled to a patent unless - 

(b) the invention was patented or described in a printed publication in this or a foreign country or in public use or on 
sale in this country, more than one year prior to the date of application for patent in the United States. 



— Claim 12 recites Zucker's theory that is not defined in patents or hteratures. 



Claim Rejections - 35 USC § 102 



3. Claims 1-2, 4-7 and 10 are rejected under 35 U.S.C. 102(b) as being anticipated 
by Christmas et al. ("Structure Matching in Computer Vision Using Probabilistic Relaxation," 



Application/Control Number: 09/884,079 Page 5 

Art Unit: 2624 

Christmas, W. J. et al, IEEE Trans. On Pattern Analysis and Machine InteUigence, vol. 17, no. 
8, August 1995, pages 749-764.) 

Christmas teaches a line based image matching method comprising: 

~ collecting line information of a query image and model images; (right column , page 

757, lst-3rd paragraphs after section VII; The scene image is the query image. The model is the 

model image.) 

- wherein the line information of each of the query and model images is expressed 
by shape descriptors; (right column , page 757, lst-3rd paragraphs after section VII) 

- defining a binary relation between lines of the query image and lines of the model 
images; (Section II; right column , page 757, lst-3rd paragraphs after section VII; Four binary 
relations are given.) 

- wherein the binary relation is invariant with respect to rotations, scale changes 
and translations; (1st paragraph of page 758) 

- wherein the binary relation includes at least one of an angular difference 
between two lines, a ratio of the lengths of the two lines, a relative location of the two lines, and 
a relative distance between the two lines; (3rd paragraph after section VII) 

~ measuring compatibility coefficients of node-label pairs of the query and model images 
based on the binary relation; (section IV, page 753; Section VII in page 758, equations 44-45) 

- wherein measuring the compatibility coefficients of the node-label pairs based 
on the binary relation comprises: 

— measuring the binary relation, denoted by ^y, for two nodes i and j 
within the set of lines of the query image; (3rd paragraph after section VII; equation (18) in page 
753) 
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— measuring the binary relation, denoted by ^xxs for two labels X and V 
within the set of lines for each of the model images; (3rd paragraph after section VII; equation 
(18) in page 753) 

— measuring the compatibility coefficients, denoted by rij(A., A.'), for the 
node-label pairs of the query and each of the model images; (equation (18) in page 753; The p 
values are the compatibility coefficients.) 

- wherein the compatibility coefficients Vij(k, V) as a measure of the strength of 
compatibility between the node-label pairs have high values corresponding to compatibility and 
low values corresponding to incompatibility; (The exponential equation results in a high value 
when the difference between the binary relations of the node-label pairs is small.) 

- measuring the similarity between the query and model images on the basis of 
continuous relaxation labeling using the compatibility coefficients; (page 751, 2nd paragraph 
including Equation (1); last paragraph of Section III in page 753; Section VIII A shows that road 
images are matched to model images. Matching inherently requires measuring the similarity 
between the query and model images.) 

wherein before measuring the similarity on the basis of the continuous relaxation 
labeling, fiirther comprising assigning a uniform initial probability to a predetermined number of 
upper node-label pairs in which the sums of the highest degree of support by each adjacent label 
for the nodes are within the range of an upper level, the initial probability being close to the final 
probabihty. (section V; especially sub-sections V.B and B.C; Only a selected model labels are 
assigned a constant given in Eq. (36). When these values are inserted into the support equation 
(15), the sum is limited to a value of Mi x the constant. Without specifying what is the condition 
close to the final probability, the selected initial condition is considered to meet the recited 
limitation.) 



Claim Rejections - 35 USC § 103 
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4. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are such that 
the subject matter as a whole would have been obvious at the time the invention was made to a person having ordinary 
skill in the art to which said subject matter pertains. Patentability shall not be negatived by the manner in which the 
invention was made. 

5. Claim 3 is rejected under 35 U.S.C. 103(a) as being unpatentable over Christmas 
as appHed to Claim 6, and further in view of Spiegel et al. (US patent 5,940,538.) 

Christmas as discussed above teaches Claim 1. Christmas further teaches: 

~ normalizing the set of lines to determine the normalized set of lines as the shape 

descriptors, (section VIII A; The image and map are scaled to match each other approximately. 

The lengths of lines are inherently normalized in the scaling process.) 

However, it does not teach the extracting, thinning and concatenating steps recited in 

Claim 3. 

Spiegel teaches a method of detecting border of an object comprising: 
~ extracting the skeleton of an object image; (Fig. 12A; edge detector 1210; The edge is 
the skeleton.) 

- thinning the skeleton; (Fig. 12 A; edge thinner 1230) 

— concatenating corresponding pixels based on the extracted skeleton to obtain a set of 
lines. (Fig. 12 A; edge linker 1240) 

It is desirable to increase the accuracy of line extraction. It is obvious that the accuracy 
of line extraction can be achieved with the increase of edge detection that as pointed out by 
Spiegel can be in turn achieved with edge thinning, (column 20, lines 7-16) It would have been 
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obvious to one of ordinary skill in the art, at the time of the invention, to apply Spiegel's teaching 
to extract lines from Christmas's model and query because the combination improves the 
accuracy of line extraction and thus improves matching accuracy. The combination thus teaches: 

- extracting the skeleton of a model image; 

~ thinning the skeleton; 

~ concatenating corresponding pixels based on the extracted skeleton to obtain a set of 



as applied to Claim 6, and further in view of Yu et al. (US patent 5,274,744.) 

Christmas as discussed above teaches Claim 6. Christmas further teaches updating 
probability according to Eq. (14) in page 752. 

However, it does not teach to set the compatibility coefficients as recited in Claim 6. Yu 
teaches a relaxation labeling process: 

-- wherein the compatibility coefficients r\j{X, V) are determined as 1 if the relation of a 
node pair (i, j) coincides with the relation of a label pair (k, A,'), (column 1, line 52 to column 2, 
line 32) 

It is desirable not to change the probability if these two relations are not related to 
improve the updating process. It would have been obvious to one of ordinary skill in the art, at 
the time of the invention, to apply Yu's teaching to modify, including normaUzation, Christmas*s 
Eq. (14) to be in the range of [-1,1], therefore the compatibility coefficients r^(X, X') are 
determined as 1 if the binary relation of a node pair (i, j) of the query image coincides with the 
binary relation of a label pair (k, X") because the combination improves the updating process. 



lines. 



6. 



Claim 8 is rejected under 35 U.S.C. 103(a) as being unpatentable over Christmas 
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7. Claims 13-14 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Christmas as applied to Claim 1, and further in view of Imagawa (US patent 5,479,570.) 

Christmas as discussed above teaches Claim 1. However, it does not teach the feature 
related to measuring similarity recited in the claims. 

Imagawa teaches a method of pattern matching for image (column 6, lines 55-58) 
comprising the following features: 

~ where measuring the similarity between the query and model data features comprises: 

- calculating the sum of the distances between corresponding query to model data 
feature pairs of the query and the model data; (column 8, lines 1-67; Because each pattem is 
represented by a vector given in Eq. (7), the distance given in Eq. (10) is the sum of the distances 
between corresponding query to model data featm-e pairs.) 

- determining the reciprocal of the sum of the distances as the similarity between 
corresponding two query and model data features; (column 7, lines 53-67) 

~ wherein the distances are measured using the Euclidean distance. (Eq. (10)) 
It is desirable to have various approaches of pattem matching to provide process 
flexibility. It would have been obvious to one of ordinary skill in the art, at the time of the 
invention, to include Imagawa's steps for measuring similarity between the query and model 
images in Christmas's method because the combination improves flexibility. The combination 
thus teaches the following features: 



- where measuring the similarity between the query and model images comprises: 
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- calculating the sum of the distances between corresponding node-to-label pairs of the 
sets of lines for the query and each of the model images; and determining the reciprocal of the 
sum of the distances as the similarity between corresponding two images. 



8. Because the above-discussed issues of 35 U.S.C. 112, second paragraphs, the 
Examiner does not compare Claims 9 and 11-12 with the prior art. 



9. Any inquiry conceming this communication or earlier communications from the 
examiner should be directed to Wenpeng Chen whose telephone number is 703 306-2796. The 
examiner can normally be reached on 8:30 am - 5:00 pm. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, David K Moore can be reached on 703 308-7452. The fax phone numbers for the 
organization where this application or proceeding is assigned are 703-872-9306 for regular 
communications and 703-872-9306 for After Final communications. TC 2600's customer service 
number is 703-306-0377. 

Any inquiry of a general nature or relating to the status of this application or proceeding 
should be directed to the receptionist whose telephone nxmiber is 703 305-4700. 



Examiner's Statement 



Conclusion 
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